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INTERACTIVE SERVICE DEVICE METERING SYSTEMS 

Technical Field of the Invention 

The present invention is directed to metering 
systems for metering usage of on-line services such as 
the Internet, off-line services such as software applica- 
tion programs, and other services. 

Background of the Invention 

The Internet and its multimedia component, the 
Web, have become an integral part of the way in which 
content is delivered to end users. For example, newspa- 
pers, magazines, and television and cable networks have 
Web sites that are increasingly being used to deliver 
content . 

This content delivered by on-line service pro- 
viders is accessed by end users by way of on-line service 
access devices. The on-line service access device most 
often in use currently is the personal computer. The 
personal computer may or may not share a monitor with a 
television. However, non- personal -computer on-line ser- 
vice access devices are being developed that will enable 
end users to connect to the Internet. These non-person- 
al-computer on-line service access devices include, for 
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example, (i) a network computer (having a basic RAM, 
little or no hard disk capacity, a modem, a monitor, and 
a keyboard; for more permanent storage, a network com- 
puter may rent storage at a remote location) , (ii) a 
gaming device (such as those used with or without televi- 
sions in order to play video games) , (iii) an Internet 
television (for example, a television equipped with an 
external Web box, or an Internet enabled television which 
is a television internally equipped with Internet access 
capability), (iv) an Internet telephone (a telephone that 
is Internet enabled) , (v) an "Internet hand held calcula- 
tor (a hand held calculator that is Internet enabled, and 
(vi) the like. All such on-line service access devices 
are referred to herein as interactive service devices 
(ISDs) . 

Many people desire to determine the amount and 
nature of interest in the content provided to end users. 
For example, advertisers who use the Internet to deliver 
ads to end users may find it useful to know the number of 
times that their ads are accessed by end users, the 
length of time that the end users spend at the ads, and 
the demographics relating to the end users who access 
their ads. Such information may indicate the target 
audience for, and popularity of, their products and/or 
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services. This information may also be useful in deter- 
mining the success of certain advertising campaigns. On- 
line service providers may also desire to determine the 
amount and nature of interest in the content that they 
provide . 

Certain web sites currently meter access to the 
content that they provide. However, metering Internet 
usage at a web site provides little opportunity to non- 
intrusively determine the demographics of the end users 
who are accessing the web site. Moreover, although the 
web site determines the number of times that its content 
is accessed, the web site does not also determine the 
number of times that other web sites are visited. Ac- 
cordingly, the web site cannot effectively extrapolate to 
the entire population or even to the segment of the popu- 
lation accessing content of competing web sites. 

It is also known to meter Internet usage 
through the use of software traps which are stored on the 
hard drives of personal computers located in statistical- 
ly selected end user facilities (e.g., households, busi- 
nesses, and the like) . These software traps log each 
access to the Internet. However, software traps have a 
number of disadvantages. For example, software traps 
require all instructions to flow through the software 
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traps. This requirement adds delay in the processing of 
these instructions. Accordingly, software traps slow 
down computer processing and can be, therefore, annoying 
to computer end users. Moreover, current software traps 
store the Internet usage data that they log on floppy 
disks which must be then mailed or otherwise non- elec- 
tronically sent to a central facility where the informa- 
tion is downloaded and processed along with Internet 
usage data from other end users in order to generate 
Internet usage reports. This manner of providing Intern- 
et usage data from statistically selected end user facil- 
ities to a central facility for report generation places 
added burdens on the end users and is slow. Furthermore, 
software traps are not currently able to meter other 
interactive service devices such as Internet televisions, 
gaming devices, network computers, and the like. 

The present invention is intended to solve one 
or more of the above -noted problems. 
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Summary of the Invention 

According to one aspect of the present inven- 
tion, a metering system comprises data acquiring means 
and data communicating means. The data acquiring means 
acquires usage data from one of a variety of interactive 
service devices. The data communicating means communi- 
cates the usage data to a remote facility. 

According to another aspect of the present 
invention, a metering system comprises data acquiring 
means and data storage means. The data acquiring means 
acquires usage data from one of a variety of interactive 
service devices. The data storage means stores the usage 
data. 

According to yet another aspect of the present 
invention, a metering system comprises passive data ac- 
quiring means and data communicating means. The passive 
data acquiring means passively acquires usage data from 
an interactive service device. The data communicating 
means communicates the usage data to a remote facility. 

According to still another aspect of the pres- 
ent invention, a metering system comprises data acquiring 
means and user identifying means. The data acquiring 
means acquires usage data relating to a user's use of an 
interactive service device. The user identifying means 
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identifies the user independently of a password and/or a 
logon identification . 

According to a further aspect of the present 
invention, a metering system comprises data acquiring 
means and data transmitting means. The data acquiring 
means acquires usage data from an interactive service 
device. The data transmitting means electronically 
transmits the usage data to a remote facility. 

According to yet a further aspect of the pres- 
ent invention, a metering system comprises data acquiring 
means and data storing means. The data acquiring means 
acquires usage data from an interactive service device. 
The data acquiring means is downloaded from a remote 
facility. The data storing means stores the data acquir- 
ing means and the usage data. 

According to still a further aspect of the 
present invention, a metering system comprises communica- 
tion line tapping means and passive data acquiring means. 
The communication line tapping means taps into a communi- 
cation line coupled to an interactive service device. 
The passive data acquiring means is coupled to the commu- 
nication line tapping means and passively acquires usage 
data from communications on the communication line. 
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According to another aspect of the present 
invention, a metering system comprises data acquiring 
means and data storing means . The data acquiring means 
acquires usage data from an interactive service device. 
The data acquiring means includes code detecting means 
for detecting an identification code in content being 
processed by the interactive service device. The data 
storing means stores the usage data and the identifica- 
tion code. 

According to yet another aspect of the present 
invention, a metering system comprises passive data ac- 
quiring means and data communicating means. The passive 
data acquiring means passively acquires usage data from a 
personal computer. The data communicating means elec- 
tronically communicates the usage data to a remote facil- 
ity. 

According to still another aspect of the pres- 
ent invention, a metering system comprises communication 
line tapping means, passive data acquiring means, data 
storing means, and data communicating means. The commu- 
nication line tapping means taps into a communication 
line coupled to a non- personal -computer. The passive 
data acquiring means is coupled to the communication line 
tapping means and passively acquires usage data from the 
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non-personal -computer. The data storing means stores the 
usage data acquired by the passive data acquiring means. 
The data communicating means communicates the usage data 
to a remote facility* 

According to a further aspect of the present 
invention, a metering system comprises passive data ac- 
quiring means, data storing means, and data communicating 
means. The passive data acquiring means passively ac- 
quires usage data from an Internet television. The data 
storing means stores the usage data acquired by the pas- 
sive data acquiring means. The data communicating means 
communicates the usage data to a remote facility. 

According to yet a further aspect of the pres- 
ent invention, a metering system comprises usage data 
acquiring means, television ratings data acquiring means, 
and data communicating means. The usage data acquiring 
means passively acquires usage data from an interactive 
service device. The television ratings data acquiring 
means acquires ratings data relating to the tuning of 
television signals by a television. The data communicat- 
ing means communicates the usage data and the ratings 
data to a remote facility. 

According to another aspect of the present 
invention, a metering system comprises data acquiring 
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means and data storing means. The data acquiring means 
acquires usage data from a video signal received by an 
interactive service device. The data acquiring means 
employs pattern matching to acquire the usage data. The 
data storing means stores the usage data. 

According to yet another aspect of the present 
invention, a method of collecting and integrating usage 
data from a plurality of facilities comprises the follow- 
ing steps: a) collecting first usage data from a plural- 
ity of end users; b) collecting second usage data from a 
plurality of content providers; and d) integrating the 
first and second usage data. 

According to. still another aspect of the pres- 
ent invention, a metering system comprises passive data 
acquiring means and data storing means. The passive data 
acquiring means passively acquires usage data from an 
interactive service device. The data storing means 
stores the usage data. 
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Brief Description of the Drawings 

These and other features and advantages of the 
present invention will become more apparent from a de- 
tailed consideration of the invention when taken in con- 
junction with the drawings in which: 

Figure 1 is a block diagram of a metering sys- 
tem according to the present inventions- 
Figure 2 is a block diagram of a metering sys- 
tem according to the present invention and implements a 
passive communication listener (PCL) for passively ac- 
quiring usage data relating to an interactive service 
device; 

Figure 3 illustrates a downloadable resident 
software passive communication listener which may be. used 
for the passive communication listener shown in Figure 2; 

Figure 4 is a flow chart representing one em- 
bodiment of the downloadable resident software passive 
communication listener of Figure 3; 

Figure 5 is a flow chart representing another 
embodiment of the downloadable resident software passive 
communication listener of Figure 3; 

Figure 6 is a block diagram of a metering sys- 
tem according to the present invention having a passive 
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communication listener for passively acquiring usage data 
relating to a personal computers- 
Figure 7 is a block diagram of a metering sys- 
tem according to the present invention having a passive 
communication listener for passively acquiring usage data 
relating to a personal computer that shares a monitor 
with a television; 

Figure 8 is a block diagram of a metering sys- 
tem according to the present invention having a passive 
communication listener for passively acquiring usage data 
relating to a non -personal -computer interactive service 
device ; 

Figure 9 is a flow chart representing one em- 
bodiment of the passive communication listener of Figure 
8; 

Figure 10 is one embodiment of a more detailed 
representation of one of the blocks of Figure 9; 

Figure 11 is another embodiment of a more de- 
tailed representation of one of the blocks of Figure 9; 

Figure 12 is a block diagram of a metering 
system according to the present invention having a pas- 
sive communication listener for passively acquiring usage 
data relating to a non -personal -computer interactive 
service device in the form of a network computer; 

- 11 - 
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Figure 13 is a block diagram of a metering 
system according to the present invention having a pas- 
sive communication listener for passively acquiring usage 
data relating to an Internet television in the form of a 
television having an external web box; 

Figure 14 is a block diagram of a metering 
system according to the present invention having a pas- 
sive communication listener for passively acquiring usage 
data relating to an Internet television in the form of a 
web enabled television; 

Figure 15 is a block diagram of a metering 
system according to the present invention having a pas- 
sive communication listener for passively acquiring usage 
data relating to an Internet television which receives 
on-line communications in a television video signal; 

Figure 16 is a flow chart representing a pro- 
gram which may be executed by a passive communication 
listeners in order to acquire usage data from content 
transmitted in television video signals; and, 

Figure 17 is a block diagram illustrating a 
usage data collection system according to the present 
invention. 

Detailed Description 
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As shown in Figure 1, a metering system 10, 
which may be located in a statistically selected end user 
facility, includes a data acquisition module 12 for ac- 
quiring usage data relative to an interactive service 
device 14. As discussed above, an interactive service 
device may be a personal computer, a personal computer 
sharing a monitor with a video display device such as a 
television, a network computer, a gaming device, an 
Internet television, an Internet telephone, an Internet 
hand held calculator, and the like. An Internet televi- 
sion is a video display device or monitor which is en- 
abled to communicate over the Internet. An Internet 
television, for example, may be a television having a web 
box, an internally enabled Internet television, or a 
television having a cable converter or modem with 
Internet communication capability. The Internet includes 
the worldwide web and/or all similar webs (such as a 
local web in an intranet environment) or networks or 
extensions thereof. Usage data as used herein means any 
and all data relating to a user's use of such on-line 
resources as the Internet, of such off-line resources as 
software programs (for example, application programs) , 
such other resources as intranets, and/or the like. 
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The data acquisition module 12, therefore, may 
acquire on-line usage data such as data relating to an 
end user's use of on-line services. Such on-line servic- 
es may include, for example, the Internet, an intranet, 
the World Wide Web, E-mail, various provider groups, and 
the like. The data acquisition module 12 may also ac- 
quire off-line usage data, such as data relating to an 
end user's use of off-line services. Off-line services 
may include, for example, application programs such as 
word processing programs, spread sheet programs, and the 
like, and are typically stored on the interactive service 
device 14, As disclosed below, the data acquisition 
module 12 may further acquire television progrsim ratings 
data. The television program ratings data may be ac- 
quired from conventional televisions, from Internet tele- 
visions, from a personal computer having a television 
tuner, and the like. 

The data acquisition module 12 acquires usage 
data with respect to the interactive service device 14, 
and transfers that usage data to a data collection module 
16 which stores the acquired usage data for immediate 
(real time) or later (non-real time) communication over a 
communication medium 18 to a data processing module 20. 
The communication medium 18 may be plain old telephone 

- 14 - 
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lines (POTS) . The communication medivim 18 may alterna- 
tively be (i) a cable, (ii) an integrated services digi- 
tal network (ISDN), (iii) an xDSL such as a digital sub- 
scriber line (DSL) , an asymmetrical digital subscriber 
line (ADSL) , or a rate adapted digital subscriber line 
(RADSL) , or (iv) any other type of medium (e.g., over- 
the-air channels) which support communication between the 
data collection module 16 and the data processing mod- 
ule 20. Any of these communication media may be arranged 
to permit the data collection module 16 to transmit its 
data and information to the data processing module 20 
during normal phone calls, during on-line service (e.g., 
Internet) communications, and the like. 

A user identification and verification module 
22 identifies and verifies the end user who is using the 
interactive service device 14, and supplies the resulting 
identification and verification information to the data 
collection module 16. The user identification and veri- 
fication module 22 may identify and verify the end user 
upon each end user logon, or the user identification and 
verification module 22 may identify and verify the end 
user periodically. The advantage of periodically identi- 
fying and verifying the end user is that the identity of 
any other end users who may operate the interactive ser- 

- 15 - 
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vice device using the original end user's logon ID and 
password will be identified and verified. For example, 
one or more other end users may operate the interactive 
service device using the original end user's logon ID and 
password when the original end user logs onto an interac- 
tive service device and then leaves the interactive ser- 
vice device without logging off. During the original end 
user's absence, one or more other end users may operate 
the interactive service device, thus using the original 
end user's logon ID and password. 

The user identification and verification module 
22 may implement, for example, biometrics recognition or 
personal characteristic recognition. As an example of 
biometrics recognition, the user identification and veri- 
fication module 22 may be of the sort disclosed in U.S. 
Patent No. 5,550,928. Such a system includes a camera 
for acquiring a current image of the end user of the 
interactive service device 14, and identifies the end 
user by comparing this current image to reference images 
stored in memory. However, the system disclosed in that 
patent is complicated by the fact that the individuals to 
be recognized by such a system may be anywhere in the 
field of vision of the camera. On the other hand, the 
end user to be recognized according to the present inven- 

- 16 - 
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tion is typically at a fixed distance, in a fixed loca- 
tion, and in a substantially uniform orientation with 
respect to the interactive service device 14. 
Consequently, there may be no need for the scaling, 
tracking, application of multiple different face recogni- 
tion techniques, and the like disclosed in the aforemen- 
tioned '928 patent. Other examples of biometrics recog- 
nition include body shape recognition which may be imple- 
mented in accordance with the teachings of the aforemen- 
tioned '928 patent, body temperature recognition as may 
be implemented through use of an infrared temperature 
detector, fingerprint recognition as may be implemented 
through the use of a fingerprint reader,, and the like. 

As an example of personal characteristic recog- 
nition, the user identification and verification module 
22 may identify and verify an end user through the use of 
keystroke recognition as may be implemented by a key- 
stroke monitor that monitors an end user's keystroke 
style (e.g., fast, slow, sporadic). 

Instead of, or in addition to, implementing 
periodic identification and verification, the user iden- 
tification and verification module 22 may determine when 
an end user has left the interactive service device. For 
example, an infrared temperature detector may be used to 

- 17 - 
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determine when an end user leaves the interactive service 
device and when an end user again appears at the interac- 
tive service device. The user identification and verifi- 
cation module 22 may then re -identify and re-verify the 
end user or require the end user to enter relevant iden- 
tification and verification information. Alternatively, 
periods of inactivity exceeding a predetermined amount of 
time may cause the user identification and verification 
module 22 to re- identify and re -verify the end user or 
require the end user to enter relevant identification and 
verification information. 

The data acquisition module 12 may take the 
form of the passive communication listeners described 
below. The data collection module 16 may have a storage 
device and a modem. The storage device stores the user 
identification and verification information supplied by 
the user identification and verification module 22 and 
the usage data acquired by the data acquisition module 
12. The modem immediately or periodically transmits this 
information and data to the data processing module 20. 

The data processing module 20 may be a computer 
at a central facility. Other metering systems, similar 
to the metering system 10, may be located in a plurality 
of other statistically selected end user facilities. The 

- 18 - 
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data processing module 20 accumulates the usage data and 
identification and verification information from the 
metering system 10 and from these other metering systems 
in order to generate reports based upon the usage data 
and the identification and verification information as 
projected over an entire population or relevant segments 
of the entire population. These reports may report the 
extent of usage of various on-line and off-line services 
covered by the usage data and may disclose the nature of 
the users of these on-line and off-line services. 

The metering system 10, and the other metering 
systems which communicate identification and verification 
information and usage data to the data processing module 
20, need not meter interactive service devices of the 
same type. Metering systems for metering several differ- 
ent types of interactive service devices in accordance 
with the present invention are disclosed below by way of 
example. In order to accommodate the metering of differ- 
ent types of interactive service devices, the data acqui- 
sition module 12 is tailored according to each type of 
interactive service device which is encountered in the 
statistically selected end user facilities. 

Thus, as will become evident from the descrip- 
tion below, one of the advantages of the present inven- 

- 19 - 
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tion is that the present invention may be used to meter a 
variety of different interactive service devices. Ac- 
cordingly, the data acquisition module 12 may take one 
form if the interactive service device 14 is a personal 
computer, may take another form if the interactive ser- 
vice device 14 is a network computer, may take still 
another form if the interactive service device 14 is an 
Internet television, and so on. 

The data acquisition device 12 may advanta- 
geously be passive with respect to the operation of the 
interactive service device being metered. Accordingly, 
unlike a software trap, the data acquisition module 12 in 
its passive form is transparent to, and does not notice- 
ably slow down the operation of, the interactive service 
device being metered. Thus, as shown in Figure 2, a 
metering system 24 includes a passive communication lis- 
tener (PCL) 26 as one type of data acquisition module. 
The passive communication listener 26 listens to the 
communications to and from an interactive service device 
28 in order to acquire usage data with regard to an end 
user's use of the interactive service device 28. The 
passive communication listener 26 may also monitor the 
end user's use of application programs by way of the 
interactive service device 28 in order to acquire addi- 
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tional usage data. The passive communication listener 26 
transfers the usage data which it acquires to a data 
storage and communication module 30. The data storage 
and communication module 30 also receives user identifi- 
cation and verification information from a user identifi- 
cation and verification module 32. The data storage and 
communication module 30 immediately or periodically tran- 
smits the user identification and verification informa- 
tion and the usage data to a data processing module 34. 

As in the case of the data acquisition module 
12 shown in Figure 1, the passive communication listener 
26 acquires on-line and off-line usage data and can also 
acquire, if desired, television program ratings data. 
The television program ratings data may be acquired from 
conventional televisions, from Internet televisions, from 
a personal computer having a television tuner, and the 
like. One of the principal advantages of the passive 
communication listener 26 is that the passive communi- 
cation listener 26 is transparent to an end user's use of 
an interactive service device. The passive communication 
listeners of the present invention also require fewer up- 
grades because they principally monitor communication 
protocols and because communication protocols change 
infrequently. Electronic communication of the usage 
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data, of the identification and verification information, 
and of television program ratings data to the data pro- 
cessing module 34 saves operating costs because mailed- in 
floppy disks do not have to be read. 

The data storage and communication module 30 
may be similar to the data collection module 16, the user 
identification and verification module 32 may be similar 
to the user identification and verification module 22, 
the communication medium 36 may be similar to the commu- 
nication medium 18, and the data processing module 34 may 
be similar to the data processing module 20, 

As illustrated in Figure 3, a passive communi- 
cation listener according to the present invention may 
take the form of a resident software passive communica- 
tion listener 40. For example, the resident software 
passive communication listener 40 may be an agent (or 
add-on) in a web browser, or it may be an insertable 
resident routine in a computer's operating system or in a 
web browser. As illustrated in Figure 3, the resident 
software passive communication listener 40 is arranged 
(i) to monitor on-line service usage, without any notice- 
able delay, by monitoring the information which flows 
from an operating system 42 to a communication device 
driver 44 and which can indicate access to on-line ser- 

- 22 - 



wo 98/26529 



PCT/US97/21643 



vices, (ii) to monitor off-line service usage by monitor- 
ing information which flows from an operating system 42 
to application programs 46, and which indicates access to 
the application programs, (iii) to monitor keyboard 
clicks, mouse clicks, touch- screen touches, remote con- 
trol signals, remote keyboard signals, remote mouse sig- 
nals, and the like which are processed by an operating 
system 42 and which indicate scrolling and the like. The 
resident software passive communication listener 40 fur- 
ther monitors communication between the communication 
device driver 44 and the operating system 42 in order to 
acquire usage data relating to the on-line content deliv- 
ered by on-line service providers or web sites. The 
resident software passive communication listener 40 
stores the acquired usage data in a memory such as a log 
file 48. The usage data logged in the log file 48 may be 
periodically or immediately transmitted to a central 
facility. 

The resident software passive communication 
listener 40 is a software tap operating similarly to the 
wire tapping passive communication listeners described 
below. The resident software passive communication lis- 
tener 40 may be installed in an operating system, and 
creates several possible processing threads. For exam- 
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pie, when a line (such as a serial communication line or 
a direct LAN line) is being used, the resident software 
passive communication listener 40 copies but does not 
immediately process the transmitted data. During periods 
when the CPU of the computer on which the resident soft- 
ware passive communication listener 40 is resident is not 
being heavily used, the resident software passive commu- 
nication listener 40 interrogates the copied transmis- 
sions and logs items of interest (such as URL's, HTML 
tags, and the like) . This procedure is different from a 
software trap because a software trap processes the tran- 
smissions in real time, whereas the resident software 
passive communication listener 40 processes the transmis- 
sions at near real time and, thus, does not slow down the 
transmissions in a way that is perceived by the user. 
Also, the resident software passive communication listen- 
er 40 does not alter the data streams or process flow of 
the socket -level transmissions. 

The resident software passive communication 
listener 40 is an event driven program. As shown in 
Figure 4, the resident software passive communication 
listener 40 includes a block 62 which detects initializa- 
tion of a modem and/or a local area network (LAN) that 
may indicate the beginning of an access to an on-line or 
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off-line service. If the computer on which the resident 
software passive communication listener 40 is resident is 
not a LAN-based computer, then the block 62 may be ar- 
ranged to detect initialization of the computer itself. 

Upon such initialization, a block 64 then moni- 
tors the modem and LAN (or other local computer) activity 
which indicates on-line and off-line service events. For 
example, the block 64 may monitor access to a web browser 
or the like which indicates the beginning of an access to 
an on-line service provider or web site. Also, the block 
64 may monitor access to an application program or the 
like which indicates the beginning of an access to an 
off-line service. A block 66 determines whether the 
activity monitored by the block 64 is on-line or off-line 
activity. If the activity is on-line activity, a block 
68 detects the communication protocol. For example, the 
block 68 may determine whether an on-line communication 
has an HTTP header indicating the beginning of an Inter- 
net communication. 

A block 70 determines whether the detected 
communication protocol is an Internet protocol. If so, a 
block 72 uses the connection between the operating system 
42 and the communication device driver 44 in order to 
read the header information of the Internet communica- 
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tion. For example, the block 72 reads the header infor- 
mation for the HTTP designation, reads the HTML's header, 
the title, tags, cookies, addresses, and so on that may 
be contained in the Internet communication. The block 72 
causes this data to be stored in the log file 48. 

If the block 70 determines that the communica- 
tion protocol detected by the block 68 is not an Internet 
protocol (such that the protocol relates to another on- 
line service) , a block 74 reads the header information, 
as well as any other pertinent information that is de- 
sired, from the detected communication and causes this 
information to be stored in the log file 48. 

If the block 66 determines that the activity 
monitored by the block 64 is not on-line activity, a 
block 76 monitors the usage of one or more of the appli- 
cation programs 46. For example, the block 76 may deter- 
mine which application programs are accessed and may 
monitor keyboard clicks, mouse clicks, touch-screen touc- 
hes, remote control signals, remote keyboard signals, 
remote mouse signals, and the like in order to determine 
the extent of usage of the accessed application programs, 
A block 78 logs this application program related usage 
data in the log file 48. The usage data logged by the 
block 78 may include an identification of the application 
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program being accessed by the end user of the computer in 
which the resident software passive communication listen- 
er 40 is resident, the length of time that the end user 
is actively using the accessed application program, and 
any other information which is desirable. The block 76 
may also be executed as a result of a timer event to 
periodically monitor application events. 

After the block 72 reads the header information 
for the HTTP designation, reads the HTML's header, the 
title, tags, cookies, addresses, and so on of an Internet 
communication, after the block 74 reads the header infor- 
mation, as well as any other pertinent information that 
is desired, from the detected communication of another 
on-line communication, or after the block 78 logs appli- 
cation program related usage data in the log file 48, 
program flow returns to the block 64 . 

With respect to the metering of on-line service 
usage, the resident software passive communication lis- 
tener 40 as embodied in Figure 4 is primarily useful in 
metering an end user's access to on-line services rather 
than the end user's use of the content that is delivered 
as a result of the access. If metering an end user's use 
of the delivered content is desirable, a program 90, 
which is shown in Figure 5, may be implemented as a modi- 
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fication of the resident software passive communication 
listener 40 shown in Figure 4. 

The program 90 replaces the block 72 shown in 
Figure 4. A block 92 of the program 90 performs the same 
functions as the block 72. In addition, a block 94 de- 
tects the presence of any identification codes which may 
be embedded in the content delivered to the corresponding 
interactive service device. For example, these identifi- 
cation codes may be used to identify specific content or 
portions of content provided by an on-line service. The 
identification codes may be embedded in the Internet data 
packets transmitted by the accessed on-line service pro- 
vider or web site to the accessing interactive service 
device, in graphics such as computer graphics, in video 
signals, in audio signals, and the like. The block 94 
logs any identification codes which it detects in a log 
file. 

A block 9 6 determines whether any of the con- 
tent delivered to the corresponding interactive service 
device is being scrolled. The block 96 may make this 
determination by monitoring related keyboard clicks, 
mouse clicks, touch- screen touches, remote control sig- 
nals, remote keyboard signals, remote mouse signals, and 
the like. If the content delivered to the corresponding 
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interactive service device is being scrolled, a block 98 
monitors the scrolling in order to determine which por- 
tions of the delivered content are being displayed on the 
monitor to the end user and how long each portion is in 
the active display of the monitor. Thus, the provider of 
the content can maJce conclusions regarding the extent of 
end user interest in the content as a whole and also in 
specific portions of the content. A block 100 logs such 
scrolling data in the log file. 

If the block 94 does not detect scrolling, or 
after the block 100 logs the scrolling data, program flow 
returns to the block 64 of Figure 4. 

The program 90 can also replace the block 74 
shown in Figure 4. In this case, the block 92 would be 
modified to read and store relevant data from headers of 
other on-line service providers or web sites. 

The resident software passive communication 
listener 40 may be downloadable over one of the communi- 
cation media described above to the computer on which the 
resident software passive communication listener 40 is 
resident. Accordingly, the resident software passive 
communication listener 40 may be changed from time to 
time as communication protocols change, as the need for 
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particular usage data changes, and/or as the particular 
interactive service device being monitored changes. 

As indicated above, the resident software pas- 
sive communication listener 40 may advantageously be used 
in a metering system which meters a personal computer. 
An example of such a metering system is shown in Figure 6 
as a metering system 110. The metering system 110 in- 
cludes a passive communication listener 112, which may be 
in the form of the resident software passive communica- 
tion listener 40 and which acquires usage data from a 
personal computer 114. This usage data is transferred by 
the passive communication listener 112 to a data storage 
and communication module 116. (The data storage and 
communication module 116 may also acquire television 
program ratings data.) The data storage and communica- 
tion module 116 stores the usage data from the passive 
communication listener 112 and also stores identification 
and verification information from a user identification 
and verification module 118. Immediately or periodical- 
ly, the data storage and communication module 116 commu- 
nicates the user identification and verification informa- 
tion from the user identification and verification module 
118 and the usage data from the passive communication 
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listener 112 over a communication medium 120 to a data 
processor 122 which may be located at a central facility. 

The data storage and communication module 116 
may be similar to the data storage and communication 
module 30, the user identification and verification mod- 
ule 118 may be similar to the user identification and 
verification module 32, the communication medium 120 may 
be similar to the communication medium 36, and the data 
processing module 122 may be similar to the data process- 
ing module 34. 

As shown in Figure 7, a metering system 130 may 
be arranged to meter a personal computer which shares a 
monitor with a television. The metering system 13 0 in- 
cludes a passive communication listener 132 which is 
arranged to accumulate usage data from a personal comput- 
er 134 that shares a monitor with a television 136. As 
in the case of the passive communication listener 112, 
the passive control listener 132 may be software similar 
to the program shown in Figures 4 and/or 5 and may be 
resident on the personal computer 134. Accordingly, the 
passive communication listener 132 accumulates usage data 
and transfers the usage data to a data storage and commu- 
nication module 138. The data storage and communication 
module 138 stores the usage data and also stores user 
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identification and verification information supplied by a 
user identification and verification module 140. The 
data storage and communication module 138 communicates 
the usage data from the passive communication listener 
132 and the user identification and verification informa- 
tion from the user identification and verification module 
140 over a communication medium 142 to a data processing 
module 144 . 

The metering system 130 shown in Figure 7 may 
also be used to accumulate television program ratings 
data. Accordingly, non- intrusive sensors 146 may be 
located adjacent to a cabinet of the television 136. 
Alternatively, or in addition to the non- intrusive sen- 
sors 146, a non- intrusive sensor 147 may be located adja- 
cent to a cabinet of the television 136, The non- intru- 
sive sensors 146 may sense the video and/or audio signals 
internal to the cabinet at a point where the video and/or 
audio signals are characteristic of the programs to which 
the television 13 6 is tuned. The sensed video and/or 
audio signals are supplied to a site unit 148 which ac- 
quires the television program ratings data from the video 
and/or audio signals sensed by the sensors 146. The non- 
intrusive sensors 146 and the site unit 148 may be simi- 
lar to the apparatus which is located at the statist i- 
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cally selected household 12 disclosed in U.S. Patent 
No. 5,481,294. 

The non- intrusive sensor 147 may be an infrared 
sensor and may sense the infrared signals transmitted by 
a remote control to the television 136. The sensed re- 
mote control signals are supplied to the passive communi- 
cation listener 132 (or alternatively to the site unit 
148) which acquires television program ratings data from 
the remote control signals sensed by the non- intrusive 
sensor 147. The non- intrusive sensor 147 and the portion 
of the passive communication listener 132 (or alterna- 
tively the site unit 148) which respond thereto may be 
similar to the apparatus disclosed in U.S. Patent No. 
4,876,736 and/or in U.S. Patent No. 4,972,503. 

The television program ratings data acquired by 
the site unit 148 and/or by the passive communication 
listener 132 may include program identification codes 
embedded in the television video and/or audio signals, 
and/or may be signatures characterizing the TV video 
and/or audio signals relating to the programs tuned by 
the television 136. 

The television program ratings data accumulated 
by the site unit 148 are transferred to a home unit 150 
which may also receive television program ratings data 
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from other site units 148 corresponding to other televi- 
sions located within the statistically selected end user 
facility in which the metering system 13 0 is located. 
Periodically! the home unit 150 supplies all of the accu- 
mulated television program ratings data to the data pro- 
cessing module 144. 

The data processing module 144 generates usage 
reports based upon the usage data acquired by the passive 
communication listener 132 and by the other metering 
systems in other statistically selected end user facili- 
ties. Similarly, the data processing module 144 accumu- 
lates the television program ratings data from the home 
unit 150 of the metering system 13 0 and from the other 
home units of other metering systems located in other 
statistically selected end user facilities and generates 
television ratings reports therefrom. 

The passive communication listeners 112 and 132 
are of the type that are resident on a personal or other 
computer. Instead, a passive communication listener 
according to the present invention may be a box or other 
apparatus which is tapped into appropriate communication 
lines or cables that carry on-line communications to and 
from an interactive service device. Alternatively, a 
passive communication listener according to the present 
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invention may be a box or other apparatus which acquires 
usage data from signals tapped by a probe non- intrusively 
coupled to an interactive service device such as an In- 
ternet television. This type of passive communication 
listener is particularly advantageous for those interac- 
tive service devices which do not have sufficient memory 
to store resident software passive communication listen- 
ers . 

For example, a metering system 160 as illus- 
trated in Figure 8 includes a home unit 161 having a 
passive communication listener 162 which is coupled by 
way of a tapping device 164 to a communication medium 166 
that may be a phone line or cable and that services a 
non-personal- computer interactive service device 168. 
The tapping device 144 may include a sensor similar to 
the sensor disclosed in U.S. Patent No. 4,972,504 and may 
also include a modem for receiving and transmitting data 
on the communication medium 166. The passive communica- 
tion listener 162 acquires on-line usage data based upon 
the communications over the communication medium 166 
between the non -personal- computer interactive service 
device 168 and on-line service providers or web sites, 
and transfers the acquired on-line usage data to a data 
store 170. As described below, the passive communication 
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listener 162 may also be arranged to acquire off-line 
usage data, and to transfer the acquired off-line usage 
data to the data store 170. The data store 170 stores 
the usage data from the passive communication listener 
162, and also stores user identification and verification 
information supplied by a user identification and verifi- 
cation module 172. As in the case of Figure 7, the data 
store 170 may also store television program ratings data 
from a television metering operations module 174 which 
receives video and/or audio signals from sensors 176. 
The data store 170 supplies its usage data, user identi- 
fication and verification information, and television 
program ratings data to the modem of the tapping device 
164 which transmits the usage data, the user identifica- 
tion and verification information, and the television 
program ratings data over the communication medium 166 to 
a central facility. 

A non- intrusive sensor 178 may be located adja- 
cent to the non-personal- computer interactive service 
device 168 and may be an infrared sensor which senses the 
infrared signals transmitted by a remote control to the 
non-personal- computer interactive service device 168. 
The sensed remote control signals are supplied to the 
passive communication listener 162 which acquires televi- 
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sion program ratings data therefrom. The non- intrusive 
sensor 178, and the portion of the passive communication 
listener 162, which respond thereto may be as described 
above . 

The passive communication listener 162 may have 
a processor for executing a program 180, which is shown 
in Figure 9, which may be arranged to meter both on-line 
and off-line usage, and which is an event driven program. 
Also, although the non - personal - computer interactive 
service device 168 may not have a hard drive, it may have 
sufficient internal memory to permit it to execute appli- 
cation programs. Such application programs, for example, 
can either be loaded from a floppy disk or can be down- 
loaded to the non-personal- computer interactive service 
device 168 over the communication medium 166 from an on- 
line service provider or web site. Accordingly, the 
program 180 may be arranged to meter off-line usage in 
addition to on-line usage. 

It should be noted, however, that the passive 
communication listener 162 relies on the tapping device 
164 to tap into on-line service communications in order 
to acquire on-line usage data. Such as arrangement is 
ill equipped to acquire off-line usage data. However, an 
off-line usage acquisition program may be temporarily 
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loaded into a RAM or other temporary memory of the non- 
personal- computer interactive service device 168 either 
by the home unit 161 or by a remote facility. Alterna- 
tively, the off-line usage acquisition program may be 
more permanently loaded into an EEPROM or other read only 
memory of the non- personal -computer interactive service 
device 168. Accordingly, not only access to application 
programs may be metered, but also scrolling and other 
activity with respect to the execution of application 
programs may be metered. 

The program 180 includes a block 182 which, 
upon the occurrence of a triggering user event or timer 
event, detects data packets being communicated on the 
communication medium 166 between the non-personal- comput- 
er interactive service device 168 and an on-line service 
provider or web site. For example, the block 182 may 
determine whether each data packet has a header indicat- 
ing a communication to or from an on-line service provid- 
er or web site. A block 184 determines whether the de- 
tected data packet includes a header indicating a Trans- 
mission Control Protocol/Internet Protocol (TCP/IP) . If 
so, a block 186 logs relevant data from the Internet data 
packet (such as relevant URLs and content) in a log file 
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188. This data may be similar to the data detected by 
the block 72. 

If the detected data packet does not include a 
TCP/IP header, a block 190 determines whether the data 
packet relates to on-line activity other than Internet 
activity. If so, a block 192 logs relevant data from the 
non- Internet on-line activity in the log file 188. If 
the data packet does not relate to any on-line activity, 
a block 194 logs off-line activities in the log file 188, 
As taught above, the block 194 may be stored in temporary 
or permanent memory of the metered interactive service 
device, A block 196 immediately or periodically trans- 
fers the usage data logged in the log file 188 to the 
modem of the tapping device 144 for communication over 
the communication medium 166. After the block 186 logs 
relevant data from the Internet on-line activity in the 
log file 188, or after the block 192 logs relevant data 
from the non- Internet on-line activity in the log file 
188, or after the block 194 logs off-line activities in 
the log file 188, the program 180 waits for the next 
event . 

A first embodiment of the block 186 is shown in 
Figure 10. This first embodiment is a routine 186' which 
includes a block 200 that reads information related to 
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Internet activities. For example, the block 200 reads 
the header information for the HTTP designation, reads 
the HTML's header, the title, tags, cookies, addresses, 
and so on that may be contained in an Internet communica- 
tion on the communication medium 160. As shown in Figure 
9, this activity is logged in the log file 188. After 
the block 200 reads and stores information related to 
Internet activities, the program 180 waits for the next 
event . 

A routine similar to the routine 18 6 can also 
be used for the block 192 shown in Figure 9. In this 
case, however, the block 200 would be modified to read 
and store relevant data from headers in data packets 
transmitted to and received from other on-line service 
providers or web sites. The block 194 may be similarly 
configured, 

A second embodiment of the block 186 is shown 
in Figure 11 as a routine 186''. The routine 186'' in- 
cludes a block 210 which detects any identification codes 
which may be embedded in the on-line communications be- 
tween the non-personal -computer interactive service de- 
vice 168 and an on-line service provider or web site over 
the communication medium 160, A block 212 logs the iden- 
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tification codes, and any other desired usage data, in a 
log file. 

A block 214 monitors scrolling of the on-line 
service content in order to determine which portions of 
the delivered content are being displayed to the end user 
and how long each portion is in the active display of a 
monitor. Thus, the on-line service provider or web site 
of the content can make conclusions regarding the extent 
of end user interest in the content as a whole and also 
in specific portions of the content. This scrolling data 
is logged by a block 216 in a log file. 

After the block 212 logs the identification 
codes, and any other desired usage data, in a log file, 
or after the block 216 logs the scrolling data in a log 
file, the program 180 waits for the next event. 

Figure 12 illustrates a metering system 230 
which is appropriate where the non-personal - computer 
interactive service device is a network computer 232. In 
this case, a home unit 234 may contain a passive communi- 
cation listener similar to the passive communication 
listener 162, a tapping device similar to the tapping 
device 164, a data store similar to the data store 170, 
and (optionally) a television metering module and sensors 
similar to the television metering operations module 174 
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and the sensors 176. Accordingly, the home unit 234 
acquires and stores user identification and verification 
information supplied by a user identification and verifi- 
cation module 236, usage data based upon on-line and off- 
line activities supported by the network computer 232, 
and television program ratings data if desired. The home 
unit 214 periodically or immediately transmits this user 
identification and verification information, usage data, 
and television program ratings data over a communication 
medium 238 to a data processing module 240 for report 
generation as described above. 

Because the network computer 232 has little or 
no hard disk, the tapping approach shown in Figure 8 may 
be used in order to acquire usage data regarding on-line 
and off-line activities. The passive communication lis- 
tener of the home unit 2 34 may implement the program 180 
described in connection "-ith Figure 9. That is, the 
passive communication i.^uener of the home unit 234 may 
have a processor programmed in accordance with Figures 9 

11. Also, because the network computer 232 has little 
or no hard disk, the block 194 may be stored in temporary 
memory of the metered network computer 232. Code imple- 
menting the functions of the block 194 may be loaded into 
such temporary memory of the metered network computer 232 
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by the passive communication listener of the home unit 
234 or by an on-line service provider or web site. Al- 
ternatively, this code may be more permanently loaded 
into a EEPROM or other read only memory of the network 
computer 232. 

Figures 13-15 illustrate metering systems which 
may be used when the non-personal -computer interactive 
service device is an Internet television. In Figure 13, 
a metering system 250 is particularly useful in the case 
where the Internet television includes a television 252 
and a web box 254. The web box 254 transmits and re- 
ceives on-line communications over a communication medium 
256 and is arranged to control the television 252 so as 
to display the on-line communications to an end user. A 
cable box 258 receives television signals and is arranged 
to control the television 252 so as to display the tele- 
vision signals to an end user. An A/B switch 260 switch- 
es the television 252 between the web box 254 and the 
cable box 258 . 

A passive communication listener 262 is shown 
connected both to the communication medium 256 and to an 
output of the A/B switch 260. The passive communication 
listener 2 62 may include a CPU, a RAM, a ROM, and a mo- 
dem. The passive communication listener 262 may also 
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include a tapping device for tapping into the communica- 
tion medium 256. Alternatively, as shown in Figure 13, 
the passive communication listener 2 62 may include a 
tapping device for tapping into the output of the A/B 
switch 260. The tapping devices may be the same as, or 
similar to, those described above. Alternatively, the 
tapping device 164 may instead be a probe mounted on the 
cabinet of the television 252 in a position to pick up 
the video that is supplied to the CRT of the television 
252. Such a probe is non- intrusive in the sense that 
opening of the cabinet of the television 252 is not nec- 
essary in order to mount the probe. This probe may be of 
the type disclosed in U.S. Patent Application Serial 
Number 08/654,306 filed on May 28, 1996. 

Accordingly, the passive communication listener 
262 may be arranged to acquire appropriate usage data and 
to transfer that usage data to a site unit 264. The 
passive communication listener 262 may acquire usage data 
in a manner similar to that described above in connection 
with Figures 9 -11 if the passive communication listener 
262 is tapped into the communication medium 256, Howev- 
er, the passive communication listener 262 may acquire 
usage data in a manner similar to that described below in 
connection with Figure 16 if the passive communication 
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listener 262 is tapped into the output of the A/B switch 
260. 

Instead of tapping into either the communica- 
tion medium 256 or the output of the A/B switch 260, the 
passive communication listener 262 may be tapped into 
both the communication medium 256 and the output of the 
A/B switch 260. 

A user identification and verification module 
266 acquires user identification and verification infor- 
mation and transfers that information to the site unit 
264. The site unit 264 may also receive television video 
and/or audio signals from sensors 268 in order to derive 
television program ratings data therefrom as described 
above. The site unit 264 transfers the usage data, the 
user identification and verification information, and/or 
the television program ratings data to a home unit 270 
which collects usage data, user identification and veri- 
fication information, and/or television program ratings 
data from other metering systems metering other interac- 
tive service devices in the end user's facility and which 
then periodically transmits all such information and data 
to a data processor module 272. The data processor mod- 
ule 272, in turn, collects usage data, user identifica- 
tion and verification information, and/or television 
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program ratings data from all other metering systems 
metering all other interactive service devices in all 
other statistically selected end user facilities in order 
to generate suitable reports. 

The communications between the home unit 270 
and the data processing module 272 may use the same com- 
munication medium 256 that supports the on-line communi- 
cations to and from the web box 254. As in the other 
metering systems described above, the home unit 270 may 
transfer its information to the data processing module 
272 during internet communications, by way of dedicated 
telephone calls to the data processing module 272, or the 
like. 

A non- intrusive sensor 274 may be located adja- 
cent to the television 252 and may be an infrared sensor 
which senses the infrared signals transmitted by a remote 
control to the television 252. The sensed remote control 
signals are supplied to the site unit 264 which acquires 
television program ratings data therefrom. The non- in- 
trusive sensor 274, and the portion of the site unit 264, 
which respond thereto may be as described above. 

The Internet television illustrated in Figure 
13 includes a television and a web box so that the tele- 
vision is, in effect, externally enabled to support on- 
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line communications. As shown in Figure 14, a metering 
system 280 may be used in the case where the television 
has internal web supporting components so that the tele- 
vision is internally enabled. This type of Internet 
television is referred to herein as a web enabled televi- 
sion and is shown in Figure 14 as a web enabled televi- 
sion 282. 

The metering system 280 includes a passive 
communication listener 284 which acquires on-line usage 
data supported by the web enabled television 282. The 
passive communication listener 284 may receive inputs 
from an appropriate output jack of the web enabled tele- 
vision 282. Preferably, although not necessarily, this 
output jack is a video output of the web enabled televi- 
sion 282. If the web enabled television 282 does not 
have an appropriate output jack for the passive communi- 
cation listener 284, the passive communication listener 
284 instead may be tapped, using the above -described 
tapping device, into a television signal and on-line 
communication input 28 6 of the web enabled television 2 82 
and/or into a communication medium 288 (such as a phone 
line or cable) which supports on-line communications to 
and from the web enabled television 282. 
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The passive communication listener 284 may be 
similar to the passive communication listener 2 62 shown 
in Figure 13. Accordingly, the passive communication 
listener 284 may acquire usage data in a manner similar 
to that described above in connection with Figure 9, or 
the passive communication listener 2 84 may acquire usage 
data by executing a program, such as will be described in 
connection with Figure 16, particularly where content 
from an on-line service provider or web site is transmit- 
ted in the vertical blanking intervals of television 
signals. The passive communication listener 282 trans- 
fers its usage data to a site unit 290 which also re- 
ceives user identification and verification information 
from a user identification and verification module 292 
and video and/or audio signals from sensors 294. This 
site unit 290 transfers to a home unit 296 the usage data 
from the passive communication listener 284, the user 
identification and verification information from the user 
identification and verification module 292, and televi- 
sion program ratings data based upon the video and/or 
audio signals from the sensors 294. The home unit 296 
periodically communicates this data and information to a 
data processing module 298 over the communication medium 
288. 

- 48 - 



wo 98/26529 



PCT/US97/21d43 



A non- intrusive sensor 3 00 may be located adja- 
cent to the television 282 and may be an infrared sensor 
which senses the infrared signals transmitted by a remote 
control to the television 282. The sensed remote control 
signals are supplied to the site unit 290 which acquires 
television program ratings data therefrom. The non- in- 
trusive sensor 300, and the portion of the site unit 290, 
which respond thereto may be as described above. 

Figure 15 illustrates a metering system 310 
which may be used in connection with an Internet televi- 
sion including a television 312 and a cable or satellite 
converter 314. The cable or satellite converter 314 
converts received television signals for display by the 
television 312. The metering system 310 includes a pas- 
sive communication listener 316 which may be coupled by a 
tapping device to a line between the television 312 and 
the cable or satellite converter 314 in order to receive 
the television signals coupled by the cable or satellite 
converter 314 to the television 312. In this case, on- 
line communications may be transmitted in the vertical 
blanking intervals of these television signals, ,and the 
passive communication listener 316 may acquire usage data 
by executing a program, such as will be described in 
connection with Figure 16. 
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Alternatively, the passive communication lis- 
tener 316 may be coupled by a tapping device to a commu- 
nication medium 318 which is used in those cases where 
on-line communications of an on-line service provider or 
web site are supported by a medium other than a televi- 
sion signal medium received by the cable or satellite 
converter 314 » In this case, the passive communication 
listener 316 may acquire usage data by executing the 
program shown in Figures 9 - 11 . 

The passive communication listener 312 acquires 
the appropriate usage data which it then transfers to a 
site unit 320. The site unit 320 also receives user 
identification and verification information from a user 
identification and verification module 322 and video 
and/or audio signals from sensors 324. The site unit 320 
transfers to a home unit 326 the usage data from the 
passive communication listener 316, the user identifica- 
tion and verification information from the user identifi- 
cation and verification module 322, and television pro- 
gram ratings data based upon the video and/or audio sig- 
nals from the sensors 324. The home unit 326 periodical- 
ly transfers this data and information to a data process- 
ing module 328 over the communication medium 318. 
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A non- intrusive sensor 330 may be located adja- 
cent to the television 312 and may be an infrared sensor 
which senses the infrared signals transmitted by a remote 
control to the television 312, The sensed remote control 
signals are supplied to the site unit 320 which acquires 
television program ratings data therefrom. The non- in- 
trusive sensor 330, and the portion of the site unit 320, 
which respond thereto may be as described above. 

Figure 16 illustrates a program 340 which may 
be executed by a passive communication listener in order 
to log usage data relating to on-line activity transmit- 
ted in video frames, such as in vertical blanking inter- 
vals of video frames. The program 340 may be resident on 
an interactive device in any manner described herein so 
as to acquire on-line usage data. The program 340 in- 
cludes a block 342 which determines whether a video sig- 
nal is being received. If a video signal is not being 
received, the block 342 continues to wait for the recep- 
tion of a video signal. If a video signal is received, a 
block 344, which may be in the form of a frame grabber, 
grabs each video frame of the received video signal. 
These video frames may be in an NTSC format. A block 346 
tests the grabbed video frame in order to determine whet- 
her the grabbed video frame contains a data packet having 
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an on-line service header (such as an internet HTTP head- 
er) . If not, program flow returns to the block 342, 

If the grabbed video frame contains a data 
packet having an on-line service header, a block 348 
determines whether an identification code is imbedded in 
the video frame grabbed by the block 344. In order to 
make this determination, the block 348 may use pattern 
matching- If the block 348 determines that an identifi- 
cation code is imbedded in the video frame grabbed by the 
block 344, a block 350 logs the identification code. If 
the block 348 determines that an identification code is 
not imbedded in the video frame grabbed by the block 344, 
a block 352 implements, pattern recognition in order to 
derive other appropriate usage data related to the con- 
tent of the on-line service data packets. That is, the 
block 352 causes the grabbed frame to be sampled in a 
predetermined manner and matches the pattern of the sam- 
ples to a reference pattern previously extracted from 
samples of appropriate portions of the frame. Such an 
appropriate portion of a frame may include particularly 
relevant content. 

After the block 350 logs an identification 
code, or after the block 352 implements pattern recogni- 
tion, a block 354 causes the logged data to be trans - 
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f erred to a home unit. A block 356 then determines whet- 
her the end user has signed off any on-line activities. 
If not, program flow returns to the block 342, If so, 
the program 340 exits. 

A collection system is shown in Figure 17 and 
includes a central data collection facility 400 which may 
be a data processor such as those described above. The 
central data collection facility 400 collects usage data 
from a plurality of metering systems 402 located at the 
facilities of end users. These end users may employ the 
interactive service devices metered by the metering sys- 
tems 402 in residences, commercial establishments such as 
businesses, governmental establishments, or the like. If 
the end user is at a business, the interactive service 
device being metered may be a proxy server that serves a 
local area network. 

The facilities in which the metering systems 
402 are located may be statistically selected in order to 
represent the entire population or a segment of the en- 
tire population relevant to usage of on-line and off-line 
services, depending on the intended scope of coverage of 
the reports which are generated on the basis of the col- 
lected usage data. 
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The usage data collected by the central data 
collection facility 400 from the metering systems 402 may 
include the identity of the on-line service providers or 
web sites accessed by end users, the number of times each 
on-line service provider or web site is accessed by end 
users, the amount of time spent at each service provider 
by end users, any identification codes embedded in the 
content delivered by on-line service providers or web 
sites, the identity of the applications programs executed 
by end users, the number of times each applications pro- 
grams is executed by end users, the amount of time spent 
in executing each applications programs, inventories of 
application programs stored at an interactive service de- 
vice, any identification codes embedded in the applica- 
tion programs executed by metered interactive service 
devices, scrolling of the content delivered by on-line 
service providers or web sites or of application programs 
executed by metered interactive service devices, the 
identity and other demographic information of the end 
users, and the like. 

The central data collection facility 400 also 
collects usage data from a plurality of on-line service 
providers 404 located at the facilities which are remote 
from the end users 402. The usage data collected by the 
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central data collection facility 400 from the on-line 
service providers 404 may include the number of times 
each on-line service provider is accessed by end users, 
the amount of time spent at each service provider by end 
users, the content provided by the on-line service pro- 
viders, and the like. Data from the on-line service 
providers 404 may be necessary as a supplement in those 
cases where transmissions to end users are hard to de- 
code, such as where the data is encrypted. However, it 
should be noted that identification and verification of 
end users is impractical when data is collected from the 
on-line service providers 404. 

In addition, the central data collection facil- 
ity 400 collects usage data from a plurality of web sites 
406 located at the facilities which are remote from the 
end users 402 and the on-line service providers 404. The 
usage data collected by the central data collection fa- 
cility 400 from the web sites 406 is easy to meter and 
may include the number of times each web site is accessed 
by an end user or an on-line service provider, the amount 
of time spent at each service provider by end users or 
on-line service providers, the content provided by the 
web site to the on-line service providers or web site, 
and the like. Again, data from the web sites 406 may be 
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necessary as a supplement in those cases where transmis- 
sions to or from end users or on-line service providers 
are hard to decode, such as where the data is encrypted. 
However, it should be noted that identification and veri- 
fication of end users is impractical when data is col- 
lected from the web sites 406. 

Certain modifications of the present invention 
have been discussed above. Other modifications will 
occur to those practicing in the art of the present in- 
vention. For example, as described above, usage data is 
first stored and is then communicated to a remote facili- 
ty, such as a central facility. Instead of storing the 
usage data before communicating it to a remote facility, 
however, the usage data can be communicated in real time, 
i.e. as soon as it is acquired. For example, the usage 
data acquirers of the present invention may be arranged 
to simply echo gets (requests transmitted by an interac- 
tive service device for on-line service from an on-line 
service provider) and receives (on-line service content 
transmitted by an on-line service provider in response to 
a request (i.e., a get) from an interactive service de- 
vice) to a remote facility without storing the usage 
data. Thus, these usage data acquirers may be arranged 
to transmit copies of the gets and receives to the remote 
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facility. For instance, the data acquirers may be ar- 
ranged to remove the URL from a get just transmitted by 
an interactive service device to an on-line service pro- 
vider, substitute the URL of the remote facility for the 
removed URL, and transmit the result as usage data. This 
data acquirer may also be arranged to copy a receive 
transmitted by an on-line service provider in response to 
a get previously sent by the metered interactive service 
device, remove the end user's URL from the copy, substi- 
tute the URL of the remote facility for the removed URL, 
and send the result as usage data. 

Moreover, the metering systems shown in Figures 
13 - 15 have been described above as acquiring usage data 
relating to on-line communications. If the Internet 
televisions are capable of executing application pro- 
grams, the metering systems shown in Figures 13 - 15 may 
also be arranged to acquire usage data relating to off- 
line communications. 

Furthermore, the passive communication listener 
4 0 is described above as being an agent in a web browser 
or an insertable resident routine in a computer's operat- 
ing system or in a web browser. Instead, the passive 
communication listener 40 may be resident on a hard drive 
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or in RAM, and the passive communication listener 40 may- 
be downloaded from a remote facility. 

In addition, because a statistically selected 
end user facility may contain different interactive ser- 
vice devices, each such different interactive service 
device may be metered by a corresponding different one of 
the passive communication listeners described above. 

Also, according to some aspects of the present 
invention, the usage data may be collected manually in 
written diaries or automatically on floppy disks, and the 
usage data may be transmitted to the central facility by 
mail, courier, or other delivery manual service. The 
particular manner in which the usage data is collected 
and transmitted depends upon the particular end users. 
For example, the interactive service devices of some end 
users may not have modems. Thus, instead of transmitting 
the usage data electronically, the usage data can be 
transmitted manually. 

As described above, television program ratings 
data may be acquired by detecting identification codes 
in, and/or extracting signatures from, video and/or audio 
signals. Instead, television program ratings data may be 
acquired in more traditional manners such as employed in 



- 58 



wo 98/26529 



PCT/US97/21643 



people meter systems, diaries, telephone surveys, and the 
like . 

Accordingly, the description of the present 
invention is to be construed as illustrative only, and is 
for the purpose of teaching those skilled in the art the 
best mode of carrying out the invention. The details may 
be varied substantially without departing from the spirit 
of the invention, and the exclusive use of all modifica- 
tions which are within the scope of the appended claims 
is reserved. 
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WHAT IS CLAIMED IS: 



1 1. A metering system comprising: 

2 data acquiring means for acquiring usage data 

3 from one of a variety of interactive service devices; 

4 and, 

5 data communicating means for communicating the 

6 usage data to a remote facility, 

1 2. The metering system of claim 1 wherein the 

2 data acquiring means acquires the usage data from a per- 

3 sonal computer. 

1 3. The metering system of claim 1 wherein the 

2 data acquiring means acquires the usage data from a non- 

3 personal - computer . 

1 4. The metering system of claim 1 wherein the 

2 data acquiring means acquires off-line usage data. 

1 5. The metering system of claim 4 wherein the 

2 data acquiring means acquires on-line usage data. 
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1 6. The metering system of claim 1 wherein the 

2 data acquiring means acquires on-line usage data. 

1 7. The metering system of claim 6 wherein the 

2 data acquiring means acquires the usage data from a per- 

3 sonal computer . 

1 8. The metering system of claim 6 wherein the 

2 data acquiring means acquires the usage data from a non- 

3 personal - computer . 

1 9 . The metering system of claim 1 further com- 

2 prising user identifying means for identifying a user 

3 independently of a password and/or a logon identifica- 

4 tion. 

1 10. The metering system of claim 9 wherein the 

2 user identifying means implements biometrics recognition. 

1 11, The metering system of claim 9 wherein the 

2 user identifying means is a personal characteristic de- 

3 tector. 
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1 12 . The metering system of claim 9 wherein the 

2 data acquiring means acquires on-line usage data. 

1 13 , The metering system of claim 1 wherein the 

2 data communicating means communicates the usage data to 

3 the remote facility though an on-line service communica- 

4 tion. 

1 14. The metering system of claim 1 wherein the 

2 data communicating means communicates the usage data in 

3 real time to the remote facility. 

1 15. The metering system of claim 1 wherein the 

2 data communicating means communicates the usage data to 

3 the remote facility by way of a phone call. 

1 16 . The metering system of claim 1 wherein the 

2 data communicating means communicates the usage data to 

3 the remote facility by way of cable. 
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1 17. The metering system of claim 1 wherein the 

2 data acquiring means is at a first statistically selected 

3 facility, wherein the data communicating means is at the 

4 first statistically selected facility, and wherein the 

5 metering system further comprises: 

6 a plurality of other data acquiring means for 

7 acquiring usage data from a plurality of other interac- 

8 tive service devices, wherein each of the other data 

9 acquiring means and a corresponding other interactive 

10 service device are located in a corresponding one of a 

11 plurality of other statistically selected facilities; 

12 and, 

13 a plurality of other data communicating means 

14 for communicating the usage data stored by the other data 

15 storing means to the remote facility, wherein each of the 

16 other data communicating means is located in a cor- 

17 responding one of the plurality of other statistically 

18 selected facilities. 

1 18. A metering system comprising: 

2 data acquiring means for acquiring usage data 

3 from one of a variety of interactive service devices; 

4 and, 

5 data storage means for storing the usage data. 
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1 19 . The metering system of claim 18 wherein 

2 the data acquiring means acquires the usage data from a 

3 personal computer. 

1 20. The metering system of claim 18 wherein 

2 the data acquiring means acquires the usage data from a 

3 non- personal - computer . 

1 21. The metering system of claim 18 wherein 

2 the data acquiring means acquires off-line usage data. 

1 22. The metering system of claim 21 wherein 

2 the data acquiring means acquires on-line usage data. 

1 23. The metering system of claim 18 wherein 

2 the data acquiring means acquires on-line usage data. 

1 24. The metering system of claim 23 wherein 

2 the data acquiring means acquires the usage data from a 

3 personal computer . 

1 25. The metering system of claim 23 wherein 

2 the data acquiring means acquires the usage data from a 

3 non-personal - computer . 
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1 26. The metering system of claim 18 further 

2 comprising user identifying means for identifying a user 

3 independently of a password and/or a logon identifica- 

4 tion. 

1 27. The metering system of claim 26 wherein 

2 the user identifying means implements biometrics recogni- 

3 tion. 

1 28. The metering system of claim 26 wherein 

2 the user identifying means is a personal characteristic 

3 detector. 

1 29. The metering system of claim 26 wherein 

2 the data acquiring means acquires on-line usage data. 

1 30. The metering system of claim 18 further 

2 comprising data communicating means for communicating the 

3 usage data to a remote facility through an on-line ser- 

4 vice communication. 

1 31. The metering system of claim 18 further 

2 comprising data communicating means for communicating the 

3 usage data to a remote facility in real time. 
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32. The metering system of claim 18 further 
comprising data communicating means for communicating the 
usage data to a remote facility by way of a phone call. 

33. The metering system of claim 18 further 
comprising data communicating means for communicating the 
usage data to a remote facility by way of cable. 

34. The metering system of claim 18 wherein 
the data acquiring means is at a first statistically 
selected facility, wherein the data storing means is at 
the first statistically selected facility, and wherein 
the metering system further comprises: 

a plurality of other data acquiring means for 
acquiring usage data from a plurality of other interac- 
tive service devices, wherein each of the other data 
acquiring means and a corresponding other interactive 
service device are located in a corresponding one of a 
plurality of other statistically selected facilities; 
and, 

a plurality of other data storing means for 
storing the usage data acquired by the other data acquir- 
ing means, wherein each of the other data storing means 
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is located in a corresponding one of the plurality of 
other statistically selected facilities. 

35. A metering system comprising: 
passive data acquiring means for passively 

acquiring usage data from an interactive service device; 
and, 

data communicating means for communicating the 
usage data to a remote facility. 

36. The metering system of claim 35 wherein 
the passive data acquiring means passively acquires the 
usage data from a personal computer. 

37. The metering system of claim 35 wherein 
the passive data acquiring means comprises software resi- 
dent on a storage device of the passive data acquiring 
means . 

38. The metering system of claim 37 wherein 
the software comprises means for monitoring scrolling of 
a display and for including data related to the monitored 
scrolling in the usage data. 
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39. The metering system of claim 37 wherein 
the data communicating means communicates the usage data 
to the remote facility though an on-line service communi- 
cation, 

40. The metering system of claim 37 wherein 
the data communicating means communicates the usage data 
to the remote facility in real time to the remote facili- 
ty. 

41. The metering system of claim 35 wherein 
the passive data acquiring means passively acquires the 
usage data from a personal computer which is arranged to 
share a monitor with a television. 

42. The metering system of claim 3 5 wherein 
the passive data acquiring means passively acquires the 
usage data from a non- personal -computer. 

43. The metering system of claim 35 wherein 
the passive data acquiring means is coupled to a communi- 
cation input to the interactive service device by way of 
a tapping device. 
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44. The metering system of claim 35 wherein 
the passive data acquiring means is coupled to a televi- 
sion/in- ternet input to the interactive service ^device . 

45. The metering system of claim 35 wherein 
the passive data acquiring means includes means for grab- 
bing video frames. 

46. The metering system of claim 35 wherein 
the passive data acquiring means is coupled to a cable 
modem input to the interactive service device. 

47. The metering system of claim 35 wherein 
the passive data acquiring means passively acquires the 
usage data from a vertical blanking interval of a video 
signal . 

48. The metering system of claim 35 wherein 
the passive data acquiring means passively acquires off- 
line usage data. 

49. The metering system of claim 48 wherein 
the passive data acquiring means passively acquires on- 
line usage data. 
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1 50. The metering system of claim 35 wherein 

2 the passive data acquiring means passively acquires on- 

3 line usage data. 

1 51. The metering system of claim 35 further 

2 comprising user identifying means for identifying a user 

3 independently of a password and/ or a logon identifica- 

4 tion. 

1 52. The metering system of claim 51 wherein 

2 the user identifying means implements biometrics recogni- 

3 tion. 

1 53. The metering system of claim 51 wherein 

2 the user identifying means is a personal characteristic 

3 detector. 

1 54, The metering system of claim 35 wherein 

2 the data communicating means communicates the usage data 

3 to the remote facility though an on-line service communi- 
i4 cation. 

1 55. The metering system of claim 35 wherein 

2 the data communicating means communicates the usage data 
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3 to the remote facility in real time to the remote facili- 

4 ty, 

1 56. The metering system of claim 35 wherein 

2 the data communicating means communicates the usage data 

3 to the remote facility by way of a phone call. 

1 57. The metering system of claim 35 wherein 

2 the data communicating means communicates the usage data 

3 to the remote facility by way of cable. 

1 58. The metering system of claim 35 wherein 

2 the passive data acquiring means is at a first statisti- 

3 cally selected facility, wherein the data communicating 

4 means is at the first statistically selected facility, 

5 and wherein the metering system further comprises: 

6 a plurality of other passive data acquiring 

7 means for passively acquiring usage data from a plurality 

8 of other interactive service devices, wherein each of the 

9 other passive data acquiring means and a corresponding 

10 other interactive service device are located in a corre- 

11 spending one of a plurality of other statistically se- 

12 lected facilities; and, 
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13 a plurality of other data communicating means 

14 for communicating the usage data acquired by the other 

15 data acquiring means to the remote facility, wherein each 

16 of the other data communicating means is located in a 

17 corresponding one of the plurality of other statistically 

18 selected facilities. 

1 59. A metering system comprising: 

2 data acquiring means for acquiring usage data 

3 relating to a user's use of an interactive service de- 

4 vice; and, 

5 user identifying means for identifying the user 

6 independently of a password and/or a logon identifica- 

7 tion. 

1 60. The metering system of claim 59 wherein 

2 the user identifying means implements biometrics recogni- 

3 tion. 

1 61. The metering system of claim 59 wherein 

2 the user identifying means is a personal characteristic 

3 detector. 



72 - 



wo 98/26529 PCT/US97/21643 



1 62. The metering system of claim 59 wherein 

2 the user identifying means periodically identifies the 

3 user. 

1 63. The metering system of claim 59 wherein 

2 the data acquiring means passively acquires the usage 

3 data from a personal computer, 

1 64. The metering system of claim 59 wherein 

2 the data acquiring means comprises software resident on a 

3 storage device of the interactive service device, 

1 65. The metering system of claim 64 wherein 

2 the software comprises means for monitoring scrolling of 

3 a display and for including data related to the monitored 

4 scrolling in the usage data. 

1 66. The metering system of claim 59 wherein 

2 the data acquiring means passively acquires the usage 

3 data from a personal computer which is arranged to share 

4 a monitor with a television. 
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1 67. The metering system of claim 59 wherein 

2 the data acquiring means passively acquires the usage 

3 data from a non-personal -computer. 

1 68. The metering system of claim 59 wherein 

2 the data acquiring means is coupled to a communication 

3 input to the interactive service device by way of a tap- 

4 ping device. 

1 69. The metering system of claim 59 wherein 

2 the data acquiring means is coupled to a televi- 

3 sion/internet input to the interactive service device. 

1 70. The metering system of claim 59 wherein 

2 the data acquiring means includes means for grabbing 

3 video frames. 

1 71. The metering system of claim 59 wherein 

2 the data acquiring means passively acquires off-line 

3 usage data. 

1 72. The metering system of claim 59 wherein 

2 the data acquiring means passively acquires on-line usage 

3 data , 
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1 73. The metering system of claim 59 further 

2 comprising data communicating means for communicating the 

3 usage data to a remote facility by way of an on-line 

4 service communication. 

1 74. The metering system of claim 59 further 

2 comprising data communicating means for communicating the 

3 usage data to a remote facility in real time. 

1 75. The metering system of claim 59 further 

2 comprising data communicating means for communicating the 

3 usage data to a remote facility by way of a phone call, 

1 76. The metering system of claim 59 further 

2 comprising data communicating means for communicating the 

3 usage data to a remote facility by way of cable. 

1 77. The metering system of claim 59 wherein 

2 the data acquiring means is at a first statistically 

3 selected facility, wherein the user identifying means is 

4 at the first statistically selected facility, and wherein 

5 the metering system further comprises: 

6 a plurality of other data acquiring means for 

7 acquiring usage data relating to users' use of a plurali- 
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8 ty of other interactive service devices, wherein each of 

9 the other data acquiring means and a corresponding other 

10 interactive service device are located in a corresponding 

11 one of a plurality of other statistically selected facil- 

12 ities; and, 

13 a plurality of other user identifying means for 

14 identifying, independently of a password and/or a logon 

15 identification, the user of a corresponding one of the 

16 other interactive service devices, wherein each of the 

17 other user identifying means is located in a correspond- 

18 ing one of the plurality of other statistically selected 

19 facilities. 

1 78. A metering system comprising: 

2 data acquiring means for acquiring usage data 

3 from an interactive service device; and, 

4 data transmitting means for electronically 

5 transmitting the usage data to a remote facility. 

1 79. The metering system of. claim 78 wherein 

2 the interactive service device is a personal computer. 
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1 80. The metering system of claim 78 wherein 

2 the interactive service device is a non-personal- comput- 

3 er . 

1 81. The metering system of claim 78 wherein 

2 the data acquiring means acquires off-line usage data. 

1 82. The metering system of claim 81 wherein 

2 the data acquiring means acquires on-line usage data. 

1 83 . The metering system of claim 78 wherein 

2 the data acquiring means acquires on-line usage data, 

1 84. The metering system of claim 78 further 

2 comprising user identifying means for identifying a user 

3 independently of a password and/or a logon identifica- 

4 tion. 

1 85. The metering system of claim 84 wherein 

2 the user identifying means implements biometrics recogni- 

3 tion. 
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1 86, The metering system of claim 84 wherein 

2 the user identifying means is a personal characteristic 

3 detector, 

1 87, The metering system of claim 78 wherein 

2 the data transmitting means electronically transmits the 

3 usage data to the remote facility by way of an on-line 

4 service communication. 

1 88. The metering system of claim 78 wherein 

2 the data transmitting transmits the usage data to the 

3 remote facility in real time. 

1 89. The metering system of claim 78 wherein 

2 the data transmitting means transmits the usage data to 

3 the remote facility by way of a phone call. 

1 90. The metering system of claim 78 wherein 

2 the data transmitting means transmits the usage data to 

3 the remote facility by way of cable, 

1 91, The metering system of claim 78 wherein 

2 the data acquiring means is at a first statistically 

3 selected facility, wherein the data transmitting means is 
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4 at the first statistically selected facility, and wherein 

5 the metering system further comprises: 

6 a plurality of other data acquiring means for 

7 acquiring usage data from a plurality of other interac- 

8 tive service devices, wherein each of the other data 

9 acquiring means and a corresponding other interactive 

10 service device are located in a corresponding one of a 

11 plurality of other statistically selected facilities; 

12 and, 

13 a plurality of other data transmitting means 

14 for electronically transmitting the usage data acquired 

15 by the other data acquiring means to the remote facility, 

16 wherein each of the other data communicating means is 

17 located in a corresponding one of the plurality of other 
18. statistically selected facilities. 

1 92. A metering system comprising: 

2 data acquiring means for acquiring usage data 

3 from an interactive service device, wherein the data 

4 acquiring means is downloaded from a remote facility; 

5 and, 

6 data storing means for storing the data acquir- 

7 ing means and the usage data. 
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93. The metering system of claim 92 wherein 
the remote facility is a first remote facility, and wher- 
ein the metering system further comprises transmitting 
means for electronically transmitting the usage data to a 
second remote facility. 

94. The metering system of claim 93 wherein 
the first and second remote facility are the same remote 
facility, 

95. The metering system of claim 93 wherein 
the data acquiring means is at a first statistically 
selected facility, wherein the data storing means is at 
the first statistically selected facility, wherein the 
transmitting means is at the first statistically selected 
facility, and wherein the metering system further com- 
prises : 

a plurality of other data acquiring means for 
acquiring usage data from a plurality of other interac- 
tive service devices, wherein each of the other data 
acquiring means is downloaded to a corresponding one of a 
plurality of other statistically selected facilities from 
the first remote facility, and wherein each of the other 
data acquiring means and a corresponding other interac- 
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tive service device are located in a corresponding one of 
the plurality of other statistically selected facilities; 

a plurality of other data storing means for 
storing the usage data acquired by the other data acquir- 
ing means and for storing the other data acquiring means, 
wherein each of the other data storing means is located 
in a corresponding one of the plurality of other statis- 
tically selected facilities; and, 

a plurality of other transmitting means for 
electronically transmitting the usage data stored by the 
other data storing means to the second remote facility, 
wherein each of the other transmitting means is located 
in a corresponding one of the plurality of other statis- 
tically selected facilities. 

96. The metering system of claim 92 wherein 
the interactive service device is a personal computer. 

97. The metering system of claim 92 wherein 
the interactive service device is a non- personal -comput- 
er. 

98. The metering system of claim 92 wherein 
the data acquiring means acquires off-line usage data. 
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1 99. The metering system of claim 92 wherein 

2 the data acquiring means acquires on-line usage data. 

1 100. The metering system of claim 92 further 

2 comprising a user identifying means for identifying a 

3 user independently of a password and/or a logon identifi- 

4 cation. 

1 101. The metering system of claim 100 wherein 

2 the user identifying means implements biometrics recogni- 

3 tion. 

1 102. The metering system of claim 100 wherein 

2 the user identifying means is a personal characteristic 

3 detector. 

1 103. The metering system of claim 92 further 

2 comprising data transmitting means for transmitting the 

3 usage data to a central facility through an on-line ser- 

4 vice communication, 

1 104. The metering system of claim 92 further 

2 comprising data transmitting means for transmitting the 

3 usage data to a central facility in real time. 
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1 105. The metering system of claim 92 further 

2 comprising data transmitting means for transmitting the 

3 usage data to a central facility by way of a phone call. 

1 106. The metering system of claim 92 further 

2 comprising data transmitting means for transmitting the 

3 usage data to a central facility by way of cable. 

1 107. The metering system of claim 92 wherein 

2 the data acquiring means is at a first statistically 

3 selected facility, wherein the data storing means is at 

4 the first statistically selected facility, and wherein 

5 the metering system further comprises : 

6 a plurality of other data acquiring means for 

7 acquiring usage data from a plurality of other interac- 

8 tive service devices, wherein each of the other data 

9 acquiring means is downloaded to a corresponding one of a 

10 plurality of other statistically selected facilities from 

11 the remote facility, and wherein each of the other data 

12 acquiring means and a corresponding other interactive 

13 service device are located in a corresponding one of a 

14 plurality of other statistically selected facilities; 

15 and, 
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a plurality of other data storing means for 
storing the usage data acquired by the other data acquir- 
ing means and for storing the other data acquiring means, 
wherein each of the other data storing means is located 
in a corresponding one of the plurality of other statis- 
tically selected facilities. 



108. A metering system comprising: 
communication line tapping means for tapping 
into a communication line coupled to an interactive ser- 
vice device; and, 

passive data acquiring means, coupled to the 
communication line tapping means, for passively acquiring 
usage data from communications on the communication line. 



109. The metering system of claim 108 wherein 
the communication line tapping means taps into a phone 
line coupled to the interactive service device. 

110. The metering system of claim 108 wherein 
the communication line tapping means taps into a local 
area network coupled to the interactive service device. 
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111. The metering system of claim 108 wherein 
the communication line tapping means taps into a video 
feed to the interactive service device. 

112. The metering system of claim 108 wherein 
the communication line tapping means is a probe arranged 
to pick off a signal being processed by the interactive 
service device. 

113. The metering system of claim 108 wherein 
the passive data acquiring means passively acquires the 
usage data from a vertical blanking interval of the video 
signal. 

114. The metering system of claim 108 wherein 
the passive data acquiring means is arranged to passively 
acquire on-line usage data from communications on the 
communication line, wherein the passive data acquiring 
means includes software resident on the interactive ser- 
vice device, and wherein the software is arranged to 
passively acquire off-line usage data from the interac- 
tive service device. 
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1 115. The metering system of claim 114 wherein 

2 the software is arranged to monitor scrolling of video 

3 displayed with respect to the interactive service device. 

1 116. The metering system of claim 114 wherein 

2 the passive data acquiring means includes means for grab- 

3 bing video frames. 

1 117. The metering system of claim 108 wherein 

2 the passive data acquiring means passively acquires the 

3 usage data from a personal computer, 

1 118. The metering system of claim 108 wherein 

2 the passive data acquiring means passively acquires the 

3 • usage data from a non- personal -computer. 

1 119. The metering system of claim 108 wherein 

2 the passive data acquiring means passively acquires off- 

3 line usage data. 

1 120. The metering system of claim 108 wherein 

2 the passive data acquiring means passively acquires on- 

3 line usage data. 
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1 121. The metering system of claim 108 further 

2 comprising user identifying means for identifying a user 

3 independently of a password and/or a logon identif ica- 

4 tion. 

1 122. The metering system of claim 121 wherein 

2 the user identifying means implements biometrics recogni- 

3 tion. 

1 123. The metering system of claim 121 wherein 

2 the user identifying means is a personal characteristic 

3 detector. 

1 124. The metering system of claim 108 further 

2 comprising data communicating means for communicating the 

3 usage data to a remote facility through an on-line ser- 

4 vice communication. 

1 125. The metering system of claim 108 further 

2 comprising data communicating means for communicating the 

3 usage data to a remote facility in real time. 
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1 126. The metering system of claim 108 wherein 

2 the communication line tapping means is at a first sta- 

3 tistically selected facility, wherein the passive data 

4 acquiring means is at the first statistically selected 

5 facility, and wherein the metering system further com- 

6 prises: 

7 a plurality of other communication line tapping 

8 means for tapping into a plurality of communication 

9 lines, wherein each of the other communication line tap- 

10 ping means is coupled to a corresponding one of the com- 

11 munication lines which is coupled to a corresponding one 

12 of a plurality of other interactive service devices, and 

13 wherein each of the other communication line tapping 

14 means and a corresponding other interactive service de- 

15 vice are located in a corresponding one of the plurality 

16 of other statistically selected facilities; and, 

17 a plurality of other passive data acquiring 

18 means for passively acquiring usage data from communica- 

19 tions on the plurality of communication lines, wherein 

20 each of the other passive data acquiring means and a 

21 corresponding other interactive service device are locat- 

22 ed in a corresponding one of the plurality of other sta- 

23 tistically selected facilities. 
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127. A metering system comprising: 

data acquiring means for acquiring usage data 
from an interactive service device, wherein the data 
acquiring means includes code detecting means for detect- 
ing an identification code in content being processed by 
the interactive service device; and, 

data storing means for storing the usage data 
and the identification code. 

128. The metering system of claim 127 wherein 
the content being processed by the interactive service 
device is an application program being executed by the 
interactive service device, 

129. The metering system of claim 127 wherein 
the content being processed by the interactive service 
device is an on-line service communication received by 
the interactive service device. 

130. The metering system of claim 127 wherein 
the identification code is in video content being pro- 
cessed by the interactive service device. 
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1 131. The metering system of claim 127 wherein 

2 the identification code is in audio content being pro- 

3 cessed by the interactive service device, 

1 132. The metering system of claim 127 wherein 

2 the identification code is in graphics being processed by 

3 the interactive service device, 

1 133. The metering system of claim 127 wherein 

2 the data acquiring means passively acquires the usage 

3 data from the interactive service device. 

1 134. The metering system of claim 133 wherein 

2 the data acquiring means comprises communication line 

3 tapping means for tapping into a communication line cou- 

4 pled to an interactive service device, and wherein the 

5 code detecting means detects the identification code from 

6 the communications on the communication line. 
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135. The metering system of claim 133 wherein 
the data acquiring means comprises a probe arranged to 
pick off a signal being processed by the interactive 
service device, and wherein the code detecting means 
detects the identification code from the signal picked 
off by the probe. 

136. The metering system of claim 133 wherein 
the data acquiring means is coupled to receive a video 
output of the interactive service device, and wherein the 
code detecting means detects the identification code from 
the video output . 

137. The metering system of claim 133 wherein 
the data acquiring means is coupled to receive an audio 
output of the interactive service device, and wherein the 
code detecting means detects the identification code from 
the audio output . 

138. The metering system of claim 127 wherein 
the data acquiring means comprises software resident on a 
storage device of the interactive service device. 
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139. The metering system of claim 138 wherein 
the software is arranged to monitor scrolling of video 
displayed with respect to the interactive service device. 

14 0. The metering system of claim 12 7 further 
comprising user identifying means for identifying a user 
independently of a password and/or a logon identifica- 
tion. 

141. The metering system of claim 140 wherein 
the user identifying means implements biometrics recogni- 
tion. 

142. The metering system of claim 140 wherein 
the user identifying means is a personal characteristic 
detector. 

143 . The metering system of claim 127 further 
comprising data communicating means for communicating the 
usage data to a remote facility through an on-line ser- 
vice communication. 
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144. The metering system of claim 127 further 
comprising data communicating means for communicating the 
usage data to a remote facility in real time. 

145. The metering system of claim 127 wherein 
the data acquiring means is at a first statistically 
selected facility, wherein the data storing means is at 
the first statistically selected facility, and wherein 
the metering system further comprises: 

a plurality of other data acquiring means for 
acquiring usage data from a plurality of other interac- 
tive service devices, wherein each of the other data 
acquiring means includes a corresponding code detecting 
means for detecting an identification code in content 
being processed by a corresponding one of the other in- 
teractive service device, and wherein each of the other 
data acquiring means and a corresponding other interac- 
tive service device are located in a corresponding one of 
a plurality of other statistically selected facilities; 
and, 

a plurality of other data storing means for 
storing the usage data acquired by the other data acquir- 
ing means, wherein each of the other data storing means 
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is located in a corresponding one of the plurality of 
other statistically selected facilities. 

146. A metering system comprising: 
passive data acquiring means for passively 

acquiring usage data from a personal computer; and, 

data communicating means for electronically 
communicating the usage data to a remote facility. 

147. The metering system of claim 146 wherein 
the passive data acquiring means comprises software resi- 
dent on a storage device of the personal computer, 

148. The metering system of claim 147 wherein 
the software comprises means for monitoring scrolling of 
a display and for including data related to the monitored 
scrolling in the usage data. 

149. The metering system of claim 147 wherein 
the software comprises means for detecting an identifica- 
tion code in content being processed by the personal 
computer. 
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150. The metering system of claim 147 wherein 
the software comprises means for employing pattern match- 
ing in order to recognize content being processed by the 
personal computer. 

151. The metering system of claim 146 further 
comprising user identifying means for identifying a user 
of the personal computer independently of a password 
and/or a logon identification. 

152. The metering system of claim 151 wherein 
the user identifying means implements biometrics recogni- 
tion. 

153. The metering system of claim 151 wherein 
the user identifying means is a personal characteristic 
detector. 

154. The metering system of claim 151 wherein 
the passive data acquiring means comprises means for 
detecting an identification code in content being pro- 
cessed by the personal computer. 
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155. The metering system of claim 146 wherein 
the passive data acquiring means comprises means for 
monitoring on-line usage. 



156. The metering system of claim 146 wherein 
the passive data acquiring means comprises means for 
monitoring off-line usage. 

157. The metering system of claim 146 wherein 
the passive data acquiring means comprises means for 
detecting an identification code in content being pro- 
cessed by the personal computer. 



158. The metering system of claim 146 wherein 
the passive data acquiring means is at a first statisti- 
cally selected facility, wherein the data communicating 
means is at the first statistically selected facility, 
and wherein the metering system further comprises: 

a plurality of other passive data acquiring 
means for passively acquiring usage data from a plurality 
of other personal computers, wherein each of the other 
passive data acquiring means and a corresponding other 
personal computer are located in a corresponding one of a 
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11 plurality of other statistically selected facilities; 

12 and, 

13 a plurality of other data communicating means 

14 for communicating the usage data acquired by the other 

15 data acquiring means to the remote facility, wherein each 

16 of the other data communicating means is located in a 

17 corresponding one of the plurality of other statistically 

18 selected facilities. 

1 159. A metering system comprising: 

2 communication line tapping means for tapping 

3 into a communication line coupled to a non-personal -com- 

4 puter; 

5 passive data acquiring means, coupled to the 

6 communication line tapping means, for passively acquiring 

7 usage data from the non-personal -computer ; 

8 data storing means for storing the usage data 

9 acquired by the passive data acquiring means; and, 

10 data communicating means for communicating the 

11 usage data to a remote facility. 
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160. The metering system of claim 159 further 
comprising software resident in an EEPROM in the non- 
personal- computer, and wherein the software is arranged 
to acquire off-line usage data. 

161. The metering system of claim 160 wherein 
the software is arranged to monitor scrolling of a dis- 
play and for including data related to the monitored 
scrolling in the off-line usage data. 

162. The metering system of claim 159 further 
comprising software downloaded to an EEPROM in the non- 
personal - computer , and. wherein the software is arranged 
to acquire off-line usage data. 

163. The metering system of claim 159 further 
comprising a plug- in software routine of a web browser on 
the non-personal - computer . 
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1 164. The metering system of claim 159 wherein 

2 the passive data acquiring means comprises means for 

3 detecting an identification code in content being pro- 

4 cessed by the non-personal -computer. 

1 165. The metering system of claim 159 wherein 

2 the passive data acquiring means comprises means for 

3 acquiring on-line usage data. 

1 166. The metering system of claim 159 further 

2 comprising user identifying means for identifying a user 

3 of the non - personal - computer independently of a password 

4 and/or a logon identification. 

1 167. The metering system of claim 166 wherein 

2 the user identifying means implements biometrics recogni- 

3 tion. 

1 168. The metering system of claim 166 wherein 

2 the user identifying means is a personal characteristic 

3 detector, 

1 169. The metering system of claim 159 wherein 

2 the communication line tapping means is at a first sta- 
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3 tistically selected facility, wherein the passive data 

4 acquiring means is at the first statistically selected 

5 facility, wherein the data storing means is at the first 

6 statistically selected facility, wherein the data commu- 

7 nicating means is at the first statistically selected 

8 facility, and wherein the metering system further com- 

9 prises: 

10 a plurality of other communication line tapping 

11 means for tapping into a plurality of communication 

12 lines, wherein each of the other communication line tap- 

13 ping means is coupled to a corresponding one of the com- 

14 munication lines which is coupled to a corresponding one 

15 of a plurality of other non- personal -computers, and wher- 

16 ein each of the other communication line tapping means 

17 and a corresponding other non-personal- computer are lo- 

18 cated in a corresponding one of a plurality of other 

19 statistically selected facilities; 

20 a plurality of other passive data acquiring 

21 means for passively acquiring usage data from the plural - 

22 ity of other non -personal -computers, wherein each of the 

23 other passive data acquiring means and a corresponding 

24 other non-personal -computer are located in a correspond- 

25 ing one of the plurality of other statistically selected 

26 facilities; 
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a plurality of other data storing means for 
storing the usage data acquired by the other passive data 
acquiring means, wherein each of the other data storing 
means is located in a corresponding one of the plurality 
of other statistically selected facilities; and, 

a plurality of other data communicating means 
for communicating the usage data stored by the other data 
storing means to the remote facility, wherein each of the 
other data communicating means is located in a cor- 
responding one of the plurality of other statistically 
selected facilities. 

170. A metering system comprising: 
passive data acquiring means for passively 

acquiring usage data from an Internet television; 

data storing means for storing the usage data 
acquired by the passive data acquiring means; and, 

data communicating means for communicating the 
usage data to a remote facility. 

171. The metering system of claim 170 wherein 
the passive data acquiring means comprises a frame grab- 
ber . 
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1 172, The metering system of claim 171 wherein 

2 the passive data acquiring means comprises means for 

3 reading a vertical blanking interval of a frame grabbed 

4 by the frame grabber. 

1 173. The metering system of claim 171 wherein 

2 the passive data acquiring means comprises means for 

3 detecting an identification code in frames grabbed by the 

4 frame grabber. 

1 174, The metering system of claim 171 wherein 

2 the passive data acquiring means acquires on-line usage 

3 data from frames grabbed by the frame grabber. 

1 175. The metering system of claim 170 wherein 

2 the passive data acquiring means acquires an identifica- 

3 tion code in content communicated Internet television. 

1 176. The metering system of claim 170 wherein 

2 the passive data acquiring means acquires on-line usage 

3 data from content communicated to the Internet televi- 

4 sion. 
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177. The metering system of claim 170 further 
comprising user identifying means for identifying a user 
of the television independently of a password and/or a 
logon identification. 

178. The metering system of claim 177 wherein 
the user identifying means implements biometrics recogni- 
tion. 

179. The metering system of claim 177 wherein 
the user identifying means is a personal characteristic 
detector. 

180. The metering system of claim 170 wherein 
the data communicating means electronically communicates 
the usage data to the remote facility. 

181. The metering system of claim 170 wherein 
the passive data acquiring means is coupled to a communi- 
cation input to the Internet television by way of a tap- 
ping device. 

182. The metering system of claim 181 wherein 
the communication input is a phone line. 
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1 183. The metering system of claim 181 wherein 

2 the communication input is a video input. 

1 184. The metering system of claim 183 wherein 

2 the video input is an input for receiving a video signal 

3 having an NTSC format, and wherein the passive data ac- 

4 quiring means comprises a frame grabber arranged to grab 

5 frames from the video signal. 

1 185. The metering system of claim 181 wherein 

2 the communication input is an input for receiving comput- 

3 er graphics, and wherein the passive data acquiring means 

4 comprises a frame grabber arranged to grab frames from 

5 the computer graphics. 

1 186. The metering system of claim 170 wherein 

2 the passive data acquiring means is at a first statisti- 

3 cally selected facility, wherein the data storing means 

4 is at the first statistically selected facility, wherein 

5 the data communicating means is at the first statisti- 

6 cally selected facility, and wherein the metering system 

7 further comprises: 

8 a plurality of other passive data acquiring 

9 means for passively acquiring usage data from a plurality 
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of other Internet televisions, wherein each of the other 
passive data acquiring means and a corresponding other 
Internet television are located in a corresponding one of 
a plurality of other statistically selected facilities; 

a plurality of other data storing means for 
storing the usage data acquired by the other passive data 
acquiring means, wherein each of the other data storing 
means is located in a corresponding one of the plurality 
of other statistically selected facilities; and, 

a plurality of other data communicating means 
for communicating the usage data stored by the other data 
storing means to the remote facility, wherein each of the 
other data communicating means is located in a cor- 
responding one of the plurality of other statistically 
selected facilities. 

187. A metering system comprising: 

usage data acquiring means for passively ac- 
quiring usage data from an interactive service device; 

television ratings data acquiring means for ac- 
quiring ratings data relating to the tuning of television 
signals by a television; and, 

data communicating means for communicating the 
usage data and the ratings data to a remote facility. 
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1 188. The metering system of claim 187 wherein 

2 the interactive service device is the television, and 

3 wherein the usage data acquiring means acquires usage 

4 data relating to on-line usage by way of the television. 

1 189. The metering system of claim 187 wherein 

2 the usage data acquiring means comprises a frame grabber. 

1 190. The metering system of claim 189 wherein 

2 the usage data acquiring means comprises means for de- 

3 tecting an identification code in frames grabbed by the 

4 frame grabber. 

1 191. The metering system of claim 189 wherein 

2 the usage data acquiring means comprises means for em- 

3 ploying pattern matching in order to recognize content in 

4 frames grabbed by the frame grabber. 

1 192. The metering system of claim 189 wherein 

2 the usage data acquiring means acquires on-line usage 

3 data from frames grabbed by the frame grabber. 

1 193. The metering system of claim 187 wherein 

2 the usage data acquiring means comprises means for de- 
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3 tecting an identification code in content being processed 

4 by the television. 

1 194. The metering system of claim 187 wherein 

2 the usage data acquiring means comprises means for moni- 

3 toring on-line usage by way of the television. 

1 195. The metering system of claim 187 further 

2 comprising user identifying means for identifying a user 

3 of the television independently of a password and/or a 

4 logon identification. 

1 196, The metering system of claim 195 wherein 

2 the user identifying means implements biometrics recogni- 

3 tion. 

1 197. The metering system of claim 195 wherein 

2 the user identifying means is a personal characteristic 

3 detector. 

1 198. The metering system of claim 187 wherein 

2 the data communicating means electronically communicates 

3 the usage data and the ratings data to the remote facili- 

4 ty. 
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1 199. The metering system of claims 187 wherein 

2 the television ratings data acquiring means comprises 

3 identification code reading means for reading program 

4 identification codes from television signals tuned by a 

5 television. 

1 200. The metering system of claims 187 wherein 

2 the television ratings data acquiring means comprises 

3 signature extracting means for extracting signatures from 

4 television signals tuned by a television. 

1 201. The metering system of claims 187 wherein 

2 the television ratings data acquiring means comprises; 

3 identification code reading means for reading 

4 program identification codes from television signals 

5 tuned by a television; and,. 

6 signature extracting means for extracting sig- 

7 natures from television signals tuned by the television. 

1 202. The metering system of claim 187 wherein 

2 the usage data acquiring means acquires off-line usage 

3 data from the interactive service device. 
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203. The metering system of claim 187 wherein 
the usage data acquiring means is at a first statistical- 
ly selected facility, wherein the television ratings data 
acquiring means is at the first statistically selected 
facility, wherein the data communicating means is at the 
first statistically selected facility, and wherein the 
metering system further comprises: 

a plurality of other usage data acquiring means 
for passively acquiring usage data from a plurality of 
other interactive service devices, wherein each of the 
other usage data acquiring means and a corresponding 
other interactive service device are located in a corre- 
sponding one of a plurality of other statistically se- 
lected facilities; 

a plurality of other television ratings data 
acquiring means for acquiring ratings data relating to 
the tuning of television signals by a plurality of other 
televisions, wherein each of the other television ratings 
data acquiring means and a corresponding other television 
are located in a corresponding one of the plurality of 
other statistically selected facilities; 

a plurality of other data communicating means 
for communicating the usage data and ratings data ac- 
quired by the other usage data acquiring means and the 
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25 other television ratings data acquiring means to the 

26 remote facility, wherein each of the other data communi- 

27 eating means is located in a corresponding one of the 
plurality of other statistically selected facilities. 

1 204. The metering system of claim 187 wherein 

2 the television from which the television ratings data is 
acquired is a conventional television. 

1 205. The metering system of claim 187 wherein 

2 the television from which the television ratings data is 
acquired is an Internet television. 

1 206. The metering system of claim 187 wherein 

2 the television from which the television ratings data is 
acquired is a computer having a television tuner, 

1 207. A metering system comprising: 

2 data acquiring means for acquiring usage data 

3 from a video signal received by a video display device, 

4 wherein the data acquiring means employs pattern matching 

5 to acquire the usage data; and, 

data storing means for storing the usage data. 
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208. The metering system of claim 207 wherein 
the video display device is a television, and wherein the 
data acquiring means acquires the usage data from the 
video signal at a video input of the television. 

209. The metering system of claim 207 wherein 
the video display device is a television, and wherein the 
data acquiring means acquires the usage data from the 
video signal at a video output of the television. 

210. The metering system of claim 207 wherein 
the video display device is a television, and wherein the 
data acquiring means acquires the usage data from a probe 
arranged to pick up a signal of the television. 

211. The metering system of claim 210 wherein 
the probe is non- intrusive . 

212. The metering system of claim 210 wherein 
the probe is at a video output of the television. 

213. The metering system of claim 210 wherein 
the probe is at a video input of the television. 
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1 214. The metering system of claim 207 wherein 

2 the data acquiring means acquires on-line usage data from 
the video display device, 

1 215. The metering system of claim 207 wherein 

the data acquiring means comprises a frame grabber. 

1 216. The metering system of claim 215 wherein 

2 the data acquiring means implements pattern matching to 

3 recognize an identification code in frames grabbed by the 

4 frame grabber and includes the identification code in the 
usage data. 

1 217. The metering system of claim 215 wherein 

2 the data acquiring means implements pattern matching to 

3 recognize on-line service content from frames grabbed by 

4 the frame grabber and includes the on-line service con- 
tent in the usage data. 

1 218. The metering system of claim 207 wherein 

2 the data acquiring means implements pattern matching to 

3 recognize an identification code from the video signal 

4 received by the video display device and includes the 

identification code in the usage data. 
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1 219. The metering system of claim 207 wherein 

2 the data acquiring means implements pattern matching to 

3 recognize on-line service content from the video signal 

4 received by the video display device and includes the on- 
line service content in the usage data. 

1 220. The metering system of claim 207 wherein 

2 the data acquiring means includes means for reading an 

3 identification code from the video signal received by the 

4 video display device and includes the identification code 
in the usage data. 

1 221. The metering system of claim 207 further 

2 comprising user identifying means for identifying a user 

3 of the video display device independently of a password 
and/or a logon identification. 

1 222. The metering system of claim 221 wherein 

2 the user identifying means implements biometrics recogni- 
tion. 

1 223. The metering system of claim 221 wherein 

2 the user identifying means is a personal characteristic 
detector. 

- 113 - 
SUBSTITUTE SHEET (RULE 26) 



wo 98/26529 



PCT/US97/21643 



224. The metering system of claim 207 wherein 
the data acquiring means is at a first statistically 
selected facility, wherein the data storing means is at 
the first statistically selected facility, and wherein 
the metering system further comprises: 

a plurality of other data acquiring means for 
acquiring usage data from video signals received by a 
plurality of other video display devices, wherein the 
other data acquiring means employ pattern matching to ac- 
quire usage data, wherein each of the other data acquir- 
ing means and a corresponding other video display device 
are located in a corresponding one of a plurality of 
other statistically selected facilities; and, 

a plurality of other data storing means for 
storing the usage data acquired by the other data acquir- 
ing means, wherein each of the other data storing means 
is located in a corresponding one of the plurality of 
other statistically selected facilities. 

225. A method of collecting and integrating 
usage data from a plurality of facilities comprising the 
following steps: 

a) collecting first usage data from a plurali- 
ty of end users; 
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6 b) collecting second usage data from a plural - 

7 ity of content providers; and, 

8 d) integrating the first and second usage 
data . 

1 226. The method of claim 225 wherein the end 

users are in residential facilities. 

1 227. The method of claim 225 wherein the end 

users are in commercial facilities. 

1 228. The method of claim 225 wherein the end 

2 users are in residential facilities and commercial facil- 
ities . 

1 229. The method of claim 225 wherein step a) 

2 comprises the step of electronically collecting the first 

3 usage data from local area networks of a plurality of end 
users . 

1 230. The method of claim 225 wherein the con- 

tent providers are on-line service providers. 
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231. The method of claim 225 wherein the con- 
tent providers are web sites. 

232. The method of claim 225 wherein step a) 
comprises the step of electronically collecting first 
usage data from a plurality of end users, wherein step b) 
comprises the step of electronically collecting second 
usage data from a plurality of content providers. 

233. A metering system comprising: 
passive data acquiring means for passively 

acquiring usage data from an interactive service device; 
and, 

data storing means for storing the usage data. 
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